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Abstract of JP2001 092980 
PROBLEM TO BE SOLVED: To provide a 
method and a device for automatically extracting 
a contour without especially designating the 
threshold value of area separation in the case of 
contour extraction for separating respective 
points into plural areas, to which these points 
belong, and extracting the boundary between the 
areas as a contour on the basis of attributes at 
the respective points of an image with respect to 
image data containing the image of an object to 
become the target of contour extraction. 
SOLUTION: The expected value of an area 
assignment probability for each point of the 
image to belong to each of areas is calculated 
(step 104), an area parameter is updated (step 
105), an evaluation function is calculated on the 
basis of a mixed probability distribution obtained 
from the area assignment probability and the 
area parameter (step 1 06), respective areas are 
separated on the basis of the area assignment 
probability (step 108) and the contour is extracted 
on the basis of the separated areas. 
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DETAILED DESCRIPTION 



: [Detailed Description of the Invention] 
5 [0001] 

[Field of the Invention] Especially this invention relates to a record medium about the 
image-processing approach and equipment at the approach equipment list which 
extracts the profile of the target body based on the attribute which each point of an 
image has to the image data containing the image of the body set as the object of a 
10 / profile extract. 



[0002] This invention relates to the profile extract approach and equipment which apply 
to the equipment which extracts fields, such as a specific organ and a neoplasm, and are 
made suitable from the image data photoed with MRI equipment, CAT equipment, etc. 

■ ■ 

15 so that it may be supposed by next explanation that it is clear. 



[0003] 

[Description of the Prior Art] From a given image, as an approach for extracting the 
image of a specific body conventionally to JP,9-299366,A (it is called "a periodical 1") 

* » ■ 

20 In order to enable the extract of the field of a suitable size using a suitable threshold in 
an ultrasonic diagnostic equipment or the field extractor which extracts the field of an 
organ, or the field of an organization based on the image data showing the tomogram for 
the organ from an MRI image, The time series data which express the area in the 

* 

extracted profile about two or more tomograms obtained for every predetermined frame 



time interval, When difference with the smoothing data which graduated the time series 
data exceeds a predetermined threshold, the profile extractor which changes the 
threshold for a profile extract and redid the profile extract is proposed. 

[0004] It is the criterion whether the value of image each point exceeds a threshold to 
image data in the equipment indicated by the above-mentioned periodical 1 using the 
1st predetermined threshold. Or an external point is determined [ next ]. the internal 
point of a field ~ from the image for every time of day It asks for the area or the volume 
of a field determined by the upper approach, and judges whether the difference of data 
before graduating and carrying out smoothness of the time series data of the area of a 
field or the volume, and the data after smooth exceeds the 2nd threshold. 

[0005] When it is judged that this difference exceeded the 2nd threshold, the profile 
extract which changed the value of the 1st threshold and was performed first is redone. 

[0006] 

[Problem(s) to be Solved by the Invention] However, there is a trouble as shown below 
in the conventional profile extract technique indicated by the above-mentioned 
periodical 1. 

[0007] Although two different thresholds are used with the equipment indicated by the 

■ - 

above-mentioned periodical 1 as the 1st trouble in order to extract a field, it is not 
shown in the concrete approach for determining these thresholds, and must be 
determined by the approach trial-and-error whenever the data set as the object of a field 



extract change. 

[0008] If a place is for example, an MRI image, it depends for whether being that to 
which the fault image photoed which part of the body, and since a suitable threshold 

■ 

changes, when an unsuitable threshold is used, it has the problem that the profile of the 
organ for which it is not asking will be extracted accidentally. 

[0009] Moreover, since it is necessary to use the time series data of image data, in order 
to ask for the field extract image of one sheet as the 2nd trouble, it is needing a vast 
quantity of data. 

* ■ ■ 

[0010] It is changing the value of the 1st threshold, repeating the same procedure again, 
and needing huge computation time in the equipment indicated by the above-mentioned 

■ ■ 

periodical 1 as the 3rd trouble, furthermore, when the difference of data is calculated 
before and after smoothing and difference's exceeds the 2nd threshold. 

• ■ 

[001 1] Therefore, this invention is made in view of the trouble mentioned above, the 
object makes it unnecessary to set up a threshold explicitly like the above-mentioned 
conventional technique, and it is in offering the profile extract approach and equipment 
which extract a profile to a high speed and high degree of accuracy. 

[0012] 

[Means for Solving the Problem] This invention which attains said object separates the 
field where said each point belongs using the field imputed probability which is a 

■ ■ 



4 



probability for image each point to belong to each field based on the attribute which not 
the value of image data itself but each point of said image has to the image data 
containing the image of the body set as the object of a profile extract, and extracts the 

- 

boundary between said fields as a profile. 

5 

[0013] The 1st process which initializes more the parameter which specifies the mixed 
probability distribution of the attribute to which said image each point has this invention 
in a detail, The 2nd process which computes the field imputed probability for each point 
of said image to belong to each of said field, The 3rd process which updates said 

10 parameter so that said mixed probability distribution may increase, The 4th process 
which computes the performance index used as the scale of presumed goodness from 
said mixed probability distribution specified with said updated parameter, It is 
characterized by having the 5th process which separates each field based on the value of 
said field imputed probability, the 6th process which extracts the boundary between said 

15 separated fields, and the 7th process image each point judges the field inner point or the 
field outer point based on said field imputed probability to be. 

[0014] The profile extract approach of this invention is characterized by carrying out by 
repeating said 2nd, 3rd, and 4th processes until predetermined conditions are fulfilled. 

20 

[0015] In the 5th process from which the profile extract approach of this invention 
separates said image into each field Ask for the one field inner point, consider this as 
the initial set of a field inner point set, and the neighborhood-of-a-point point belonging 
to said field inner point set is acquired. When the point which considers said near point 



5 

as the initial set of a boundary candidate set, chooses the point belonging to a field inner 

■ • 

point set from each point of said boundary candidate set, adds to a field inner point set, 
and is newly added to said field inner point set is lost Are the profile extract approach of 
sending a field inner point set to the 6th process, acquire the near point to each point 
5 which belongs to a boundary candidate set in case said field inner point set is chosen, 
and if all points are the field inner points soon If the point belonging to this boundary 
candidate set is added to a field inner point set and the one or more field outer points are 
contained in said near point It is characterized by adding the field inner point which 
adds the point belonging to this boundary candidate set to a boundary point set, and is 
10 not added to a field inner point set among the field inner points belonging to said near 
point to said boundary candidate set. 

[0016] In the 6th process from which the profile extract approach of this invention 
extracts the boundary between said fields Set up the initial value of the boundary point 
15 set which was able to be set in order, and the midpoint of each point belonging to said 
boundary point set which was able to be set in order is added. Make it move until a 
midpoint turns into the boundary point, and it is characterized by repeating until it 

■ * 

becomes impossible to add a new midpoint, and sets to migration of said midpoint. It is 
characterized by adding to the boundary point set which was able to be set in order 
20 when this midpoint was already the boundary point, moving a midpoint in the direction 
of the field exterior, if this midpoint is the field inner point, and making it move inside a 
field, if this midpoint is the field outer point. 

[0017] The profile extract approach of this invention is characterized by having the 8th 



process which forms said image into rough **, the 9th process which subdivides said 
image formed into rough **, and the 10th process which deletes the point that the 
probability belonging to a predetermined field is small. 

■ 

[0018] The profile extract approach of this invention is characterized by using said 
mixed probability distribution as said performance index. 

[0019] The profile extract approach of this invention is characterized by using the 

* 

SUTORAKUCHURARU risk (Structural Risk) computed from the number of said 
mixed probability distributions and said parameters as said performance index. 

[0020] The profile extract approach of this invention is characterized by using the 
description length computed from the number of said mixed probability distributions 
and said parameters as said performance index. 

[0021] The profile extract approach of this invention is characterized by using the 
information criterion (AIC) of Akaike computed from the number of said mixed 
probability distributions and said parameters as said performance index. 

[0022] As opposed to the image data containing the image of the body with which the 
profile extractor of this invention is set as the object of a profile extract Said each point 
is classified into two or more fields to which the point belongs based on the attribute 
which each point of said image has. 1st means to initialize the parameter which 
specifies the mixed probability distribution of the attribute in which it is the profile 



7 

extractor extracted as a profile, and said image each point has a boundary between said 
fields, 2nd means to compute the expected value of the field imputed probability for 
each point of said image to belong to each of said field, 3rd means to update said 
' parameter so that said mixed probability distribution may increase, 4th means to 
5 compute the performance index used as the scale of presumed goodness from said 

mixed probability distribution specified with said updated parameter, It is characterized 
by having 5th means to separate each field based on the value of said field imputed 
probability, 6th means to extract the boundary between said separated fields, and 7th 
means by which image each point judges the field inner point or the field outer point 
10 . based on said field imputed probability. 

* 

* 

[0023] The profile extractor of this invention is characterized by having 8th means to 
form said image into rough **, 9th means to subdivide said image formed into rough 
**, and 10th means to delete the point that the probability belonging to a predetermined 
15 field is small. 

[0024] 

[Embodiment of the Invention] The gestalt of operation of this invention is explained. 
The profile extract approach of this invention separates the field where said each point 
20 belongs using the field imputed probability which is a probability for image each point 
to belong to each field based on the attribute which each point of said image has to the 
image data containing the image of the body set as the object of a profile extract, and 
extracts the boundary between said fields as a profile. 



8 

[0025] As opposed to the image data containing the image of the body with which this 
invention is set as the object of a profile extract Based on the attribute which each point 
of said image has, the field where said each point belongs is separated. 1st means to 
initialize the parameter which specifies the mixed probability distribution of the 
attribute in which it is the profile extractor extracted as a profile, and each point of said 
image has a boundary between said fields, 2nd means to compute the expected value of 
the field imputed probability for each point of said image to belong to each of said field, 
3rd means to update said parameter so that said mixed probability distribution may 
increase, 4th means to compute the performance index used as the scale of presumed 
goodness from said mixed probability distribution specified with said updated 
parameter, It has 5th means to separate each field based on the value of said field 
imputed probability, 6th means to extract the boundary between said separated fields, 
and 7th means by which image each point judges the field inner point or the field outer 
point based on said field imputed probability. 

[0026] In this invention, based on the value of each point of an image, the probability 
belonging to the field to which each point was given is computed, and a profile extract 
is performed using the probability distribution searched for. 

[0027] Below, the case where this invention is applied to the approach of classifying 
into three fields other than a brain, the scalp, and a head from the MRI image of a body 
head is explained to an example about a principle and an operation of this invention. 

[0028] Moreover, below, although the vocabulary "a field extract" may be used instead 



of "a profile extract 1 ', since it will be obtained if a line is drawn on the boundary of the 
field where the profile was extracted when the field could be extracted, a synonym is 

considered and it does not interfere. 

* 

[0029] First, it comes and an image expresses with f (yj|thetai) a group, then the 
probability for the value of the brightness of the j-th point (the point on an image is 
hereafter called "pixel" (pixel)) to be yj on an image to the i-th field. Here, thetai is a 
parameter which shows the attribute of the i-th field, and uses the average of the pixel 
value belonging to this field, distribution, etc. as an attribute of a field, for example. 

[0030] However, before the extract of a field is performed, an average or distribution of 
each field cannot be defined with a natural thing. 

[003 1] In this invention, the mixed probability distribution which took the weighted 
average of the probability of each field is used as probability distribution explaining the 
pixel value of the given image. 

[0032] The mixed probability distribution P (theta|Yn) when all pixel value Yn= {yl, — , 
yn} is given is given by the degree type (1) noting that an image has n pixels in all. 

* 

[0033] 

P(thetajYn) =sigmaisigmaj wi f (yj|thetai) — (1) [0034] wi is a ratio which each field 
occupies on [ all ] an image here. Moreover, theta expresses all the parameters wi and 
thetai collectively. 



!0 

* 

[0035] Below, it considers that this mixed probability distribution P (theta|Yn) is the 
function of Parameter theta, and is called mixed likelihood. 

5 [0036] Now, in this invention, in order to perform a profile extract, it is necessary to 
divide appropriately to which field each pixel belongs. For that purpose, what is 
necessary is just to ask for the mixed likelihood which most often explains distribution 
of the acquired pixel value. 

10 [0037] What is necessary is just to specifically ask for the parameter which makes a 
mixed probability max. This is an approach learned for statistics as the maximum 
likelihood method, mixing defined by the degree type (2) in the maximum likelihood 
method — a logarithm — likelihood (likelihood function) may be maximized. 

15 [0038] L(theta|Yn) =log [P (theta|Yn)] - (2) [0039] However, when using distribution 
of an average pixel value and a pixel value, for example as an attribute of a field, it is 
difficult, if it is necessary to ask for the mixed ratio w of each field, the average of a 
pixel, and distribution from each field and the field extract is not performed beforehand. 

20 [0040] In order to solve this problem, in this invention, the hidden variable Z which 
shows to which field each pixel belongs is newly introduced, and mixed likelihood is 
maximized using the estimate of this variable. In the process of maximization of mixed 
likelihood, the mixed ratio w of each field, the average of a pixel, and distribution can 
be presumed simultaneously. The principle is as follows. 
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• * 

[0041] mixing by the basis to which Data Yn were given ~ a logarithm - it is expressed 
with a degree type (3), when likelihood is rewritten so that Variable Z may be included 
using the formula of Bayes. 

[0042] 

L(theta|Yn) =L(theta, Yn|Z)-L(Z|theta, Yn)+log [P(Z)/P (Yn)] ~ (3) [0043] although P 
(Z) and P (Yn) are what is called prior distribution of Z and Yn, respectively here - this 

♦ 

amount — theta — not containing — mixing — a logarithm — since maximization of 
. likelihood is unrelated, below, it is regarded as a constant and ignores. 

■ 

[0044] If initial value of theta is set to theta 0, the probability distribution P of Z in the 
basis by which data and a parameter were given to both sides (Z|theta, Yn) is imposed 
and the expected value about z is taken now, it will become a degree type (4). 

[0045] E(theta|Yri) =Q~(theta, thetaO) +H (theta, thetaO) -- (4) [0046] Here Q(theta, 

■ ■ 

thetaO) =EthetaL(theta 0, Yn|Z)]=sigmaZ P (Z|theta, Yn) L (theta 0, Yn|Z) -- (5) is the 
expected value of L (theta 0, Yn|Z). 

[0047] moreover -- H (theta, theta 0) =-EthetaL(Z|theta 0, Yn) =-sigmaZ P (Z|theta, Yn) 

■ * 

L(Z|theta0, Yn) -- (6) is the expected value of L (Z|theta 0, Yn). . 

[0048] Being set to H(theta0, thetaO) <=H (theta, thetaO) can always show this H (theta, 
thetaO) easily. 
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[0049] therefore - if it determines that it is set to Q(theta0, thetaO) <=Q (theta, thetaO) 
by new theta — a mixture — it can ask for the parameter which makes number likelihood 
max. 

5 

[0050] As stated above, when there are imagination data (the upper example Z) which 
cannot carry out direct observation, the approach of maximizing likelihood is 
conventionally learned for the statistical field as an EM algorithm. It is related with EM 
algorithm and is reference A.P.Dempsteret, for example, al. Maximum Likelihood from 
10 Incomplete Data via EM Algorithm, Proceedings of the Royal Statistical It is detailed to 
Society and pp. 1-38 (1977). 

[005 1] pass the above processing — a mixture— if parameter theta* which makes 
number likelihood max is obtained, it can be considered that the expected value of z for 
15 which it asked using this theta* is the field imputed probability for each pixel to belong 
to each field. 

[0052] For example, when the j-th pixel belongs z (j, i) to the i-th field, and when it is 1 
and the variable which takes 0 when other, the expected- value h(j, i) =E theta* z (j, i) 
20 serves as the field imputed probability to take the value from 0 to 1 . 



[0053] In this invention, a field is separated based on the value of this field imputed 
probability. 
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[0054] For example, what is necessary is just to choose the pixel belonging to a cerebral 
field from a pixel with the big value of h (j, 2), if the field corresponding to a field 2 and 
the scalp for the field corresponding to - brain is made into a field 1 on an image and the 
other field is made into a field 0. The scalp and the other field can be similarly extracted 
by choosing a pixel with the respectively big value of h (j, 1) and h (j, 0). 

• - * 

[0055] Thus, in this invention, each field can be clearly separated using a field imputed 

* 

probability, and the profile extract of each field can be automatically performed by 
making the pixel of the boundary of each separated field into a profile. 

* ■ 

[0056] 

[Example] Next, the example of this invention is further explained to a detail with 
reference to a drawing. The notation used in the following explanation shall follow the 
usage of the notation used by the above-mentioned explanation. Moreover, although the 
following examples explain taking the case of the approach of extracting a brain, the 
scalp, and three external fields and asking for each profile from the fault image of the 
body head photoed with MRI equipment, when extracting the profile of the heart of a 
body thorax, and other organs, for example, it can carry out by the same approach. 
Moreover, it can perform by the same approach also to the image photoed using the 

* 

devices, for example, the CAT equipment, and ultrasonic diagnostic equipments other 
than MRI equipment. 

* 

[0057] The MRI image is expressed by the brightness which image each point 
(henceforth a "pixel") has as shown in drawing 5 . Brightness usually takes values, such 
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as 0 to 255, and an image is displayed white, so that the value of a pixel becomes large. 
A hand makes the value of this brightness a loan and a profile extract separates a field 
as that to which the value of brightness belongs a near pixel to the same field. Below, a 
field 0 is explained for fields other than a head, and a field 1 and a brain are explained 
for the scalp as a field 2. 

[0058] Moreover, in this example, average luminance mui of a pixel and distributed 

sigmai2 (1 i= 0, 2) belonging to each field are used as a parameter by which a field is 

characterized. Below, these parameters are called "field parameter." 

[0059] Drawing 1 is the block diagram showing the configuration of the profile 

extractor of the 1 st example of this invention. Drawing 2 thru/or drawing 4 are flow 

charts which show the procedure of the profile extractor of the 1st example of this 

invention. 

[0060] The data analysis equipment 1 which will input this profile extractor from the 
image entry-of-data equipment 1 1 photoed with MRI equipment etc., and will analyze 
the property of this input image data if drawing 1 is referred to, The field imputed 
probability calculation equipment 2 which computes a field imputed probability based 
on the value of each pixel of the given image, The renewal equipment 3 of a parameter 
which updates a field parameter so that the value of a performance index may increase 
or decrease, The performance-index calculation equipment 4 which computes a 
performance index from the updated field parameter, The field decollator 5 which 
determines to which field each pixel belongs based on the presumed field imputed 
probability, The field imputed judging equipment 6 which judges whether the specified 
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pixel belongs to the specified field about the pixel used as the boundary of each field, It 
has the boundary extractor 7 which generates the border line with which sequence 
reached from the extracted field, the input unit 1 1 which inputs the image set as the 
object of a profile extract, and the output unit 12 which outputs the result of a profile 
extract, and is constituted. 

[0061] Next, processing of the profile extract in the profile extractor of the 1st example 
of this invention is explained with reference to the flow chart of drawing 1 and drawing 
2 thru/or drawing 4 . ■ 

[0062] First, the image data of the body head photoed with MRI equipment etc. is 
inputted with an input device 1 1 (step 101). This input unit 1 1 is realizable using for 
example, an image scanner etc. Or it is also possible to carry out the direct input of the 
image data through a computer network from MRI equipment etc. An input device 1 1 
sends the read data to data analysis equipment 1. 

[0063] Next, in data analysis equipment 1, the property is analyzed to the data read at 
step 101 (step 102). As a property of data, there are an average, distribution, etc. of a 
total pixel value, for example. 

■ 

[0064] With data analysis equipment 1 , the initial value of the field parameter by which 
each field is characterized is defined based on these properties (step 103). for example, 

» 

in the MRI image of a body head, a brain field has the highest brightness and the 
exterior is expressed with the lowest brightness - having — the scalp — a field has the 
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middle brightness. As a field parameter by which follows, for example, each field is 
characterized, an average and distribution of a pixel value are taken and the initial value 
of average mui (1 i= 0, 2) of the pixel value in each fields 0, 1, and 2 is calculated by 
the degree type (7). 

[0065] mui — aimu — (7) [0066] Here, mu is the average of all pixels, ai is a weighting 
factor, and it is a0=l/6, respectively. al=2/6 It sets with a2=3/6, etc. 

[0067] By choosing initial value in this way, it is promptly completed by renewal of the 
parameter in optimization of a performance index. 

[0068] About distributed sigmai2, the small initial value in a field 0 (fields other than a 
head) may be taken, and distribution of the whole image may be used for the initial 
value of the other field as it is, for example. 

[0069] As long as the number of the fields which should be separated becomes three, 
you may make it initialize the mixed ratio w of each field as 1/3 altogether. 

[0070] Next, in field imputed probability calculation equipment 2, the probability for 
each pixel to belong to each field is computed (step 104). 

[0071] The following approaches are used in order to search for a field imputed 
probability concretely. 
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[0072] If it turns out beforehand whether the j-th pixel belongs to the i-th field, or it 
does not belong, the mixed probability which the top type (1) defined will be given by 
the degree type (8). 

[0073] 

P (theta|Yn) =sigmaisigmaj z (j, i) wi f (yj(thetai) (8) [0074] Here, the j-th pixels of z 
0, i) are a group, then the variable which comes, and is set to 0 when other, 1 and to the 
i-th field. Since this variable cannot be observed actually, it makes this a field imputed 
probability in quest of that expected value h (j, i). If a field imputed probability is 
expressed concretely, it will be given by the degree type (9). 

[0075] 

* 

h (j, i) =Etheta* z (j, i) = wi f (yj(thetai) /sigmaisigmaj wi f (yj|thetai) — (9) [0076] Next, 
in the renewal equipment 3 of a parameter, the field parameter wi and thetai are changed 
so that mixed probability distribution may increase (step 105). 

■ * 

. • • ■ 

[0077] It explains especially here taking the case of the case where the probability 
distribution f of a field (yj |thetai) follows the normal distribution of average mui and 
distributed sigmai2. 

[0078] What is necessary is just to update w, mu, and sigmai2 so that Q defined by the 
top type (5) may be made into max in order to maximize a mixed probability for it to 
mention above. 
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[0079] Specifically, each field parameter is updated as follows. 

[0080] wi = sigmajh(j, i)/n - (10) [0081] mui = sigmajxjh(j, i)/sigmajh Q, i) — (1 1) 
[0082] 

5 sigmai2= sigmaj(xj-mui)2 h(j, i)/sigmajh (j, i) - (12) [0083] The renewal equipment 3 
of a parameter sends the updated field parameter to performance-index calculation 
equipment 4. 

[0084] With performance-index calculation equipment 4, a performance index is 
10 computed using the field parameter updated with the renewal equipment 3 of a 
parameter (step 106). 

[0085] The mixed probability distribution (1) itself may be used as a performance index. 
In this case, a presumed result is so good that the value of mixed distribution is large. In 
1 5 a performance index, a SUTORAKUCHURARU risk may be used and description 

length may be used. Furthermore, the amount of information (AIC:Akaike Information 
Criteria) of Akaike can also be used. 

[0086] These performance indices are computed from the number of mixed distribution 
20 and field parameters, and a value becomes small, so that mixed likelihood is large, and, 
so that there are few field parameters used. 

[0087] Therefore, these performance indices express that a presumed result is so good 
that a value is small. About the concrete method of computing these performance 
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indices, the publication of Japanese Patent Application No. No. 124851 [ ten to ] is 
referred to, for example. 

♦ ■ 

* 

[0088] The new performance-index value computed in performance-index calculation 
5 equipment 4 using the updated field parameter will be compared with the last 

performance-index value currently computed using the field parameter before updating, 
and at step 107, if the difference is smaller than the predetermined value defined 
beforehand, it progresses to step 108, and in being other, return and a new field 
parameter will be used for step 104, and it will compute a field imputed probability 
10 again. 

» 

[0089] By repeating step 107 from the above-mentioned step 104, the field parameter 
and field imputed probability which make mixed probability distribution max can be 

* 

searched for. 

15 

[0090] Performance-index calculation equipment 4 sends the field imputed probability 
and field parameter which were obtained to the field decollator 5, after maximization of 
mixed probability distribution is completed. 

20 [Q091] The field decollator 5 separates each field based on a field imputed probability 

* 

(step 108). 

■ • 

[0092] Although it explains here from the MRI image of the body head shown in 

* 

drawing 5 taking the case of the procedure which extracts the field corresponding to a 
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brain in order to show the processing in the field decollator 5 concretely, processing can 
be performed in the completely same procedure also about other fields. 

[0093] As shown in drawing 6 , each pixel 51 shall be numbered beforehand. 

5 

[0094] The extracted field is expressed by the set of this number. In drawing 6 , if the 
field 52 surrounded by the pixel by which inverse video was carried out black is 
expressed with R, it can be expressed as R= {258, 259, 260, 514, 515, 
516,770,771,772} using the number of a pixel. 

10 

[0095] The borderline which divides a field and the field exterior can be similarly 

* 

expressed as a set of a pixel number. 

[0096] For example, in drawing 6 , the borderline B shown using the set 52 of a pixel by 
15 which inverse video was carried out black can be expressed as B= {258, 259, 260, 514, 
516,770,771,772} using the number of a pixel. 

[0097] the set R of the internal point of the field surrounded by the borderline at this 
time (henceforth "a field inner point set") - 1 it becomes the set which consists of this 
20 pixel (515). 

[0098] If the field corresponding to a brain is described as a field 2, in the field 
decollator 5, the field imputed probability h of each pixel (j, 2) will be first sent to field 
imputed judging equipment 6. 
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[0099] When the signal which shows that it belongs to the brain field from field 
imputed judging equipment 6 is returned to the pixel used as the object for a judgment, 
let this be the first field inner point p (step Al of drawing 3 ). 

* 

5 

[0100] As the approach of a field imputed judging, when fulfilling conditions, like that 
the value of h (j, 2) is 0.9 or more, or it is not 0.1 or less, it is regarded as what belongs 

* 

to a field, for example. Since the probability value of the point which does not belong to 
a field is almost 0.0, the field imputed probability acquired eventually actually does not 
10 need to set a threshold as a positive (explicit). 

[0101] Next, to the field inner point p, the set N of the near point (p) is acquired, arid 
this is considered as the first boundary candidate set C (step A2). Point N (p) will mean 
the point close to Point p soon, for example, the 5 1 5th neighborhood-of-a-point point N 
15 (515) will become N(5 15)= {258,259,230,514, 516,770,771,772} in drawing 6 : The 

* » 

* 

boundary candidate set C serves as a candidate of a cerebral profile point. 

[0102] Next, the near point N (c) is searched for from each point (boundary candidate 
point) c belonging to a boundary candidate set (step A3 of drawing 3 ). 

20 

[0103] Next, it judges whether they are delivery and the field inner point to field 
imputed judging equipment 6 for the field imputed probability about all the points 
belonging to N (c) (step A4 of drawing 3 ). 
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[0104] In step A4, if judged with all the near points N of the boundary candidate point c 
(c) being the field inner points, since it means that Point c is surrounded in the field 
inner point, Point c is added to the field inner point set R (step A5 of drawing 3 ). 

[0105] Since it means that C adjoins the point outside a field supposing at least one . 
point which is not is included in all the near points N of the boundary candidate point c 
(c) in the field inner point, c is added to the boundary point set B (step A6 of drawing 3 

[0106] Next, if there is the new field inner point which is not added to the field inner 
point set R yet at the point judged among the points belonging to N (c) to be the field 
inner point, these points will be added to the boundary candidate set C (step A7 of 
drawing 3 ). 

[0107] At step A8 of drawing 3 , since the field extract will be completed if it 
investigates whether there was any new another point to a boundary candidate set, and 
there is new another point, and there are not return and new another point in step A3, it 
progresses to step 109 of drawing 1 . 

[0108] As mentioned above, the boundary point set B which is a set of a point which 
expresses a cerebral profile eventually is obtained from step A3 of drawing 3 by 
repeating step A8 until new another point is lost. 

[0109] The field decollator 6 sends the boundary point set B and the field inner point set 
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R which were obtained to the boundary extractor 7. 

[0110] In the boundary extractor 7, a profile is extracted based on the field inner point 
set R obtained with the field decollator 6. 

5 

[01 1 1] The sequence of each boundary point is not taken into consideration, but the 
application up utilization of the boundary point set B obtained with the field decollator 6 
may be hard to be carried out. For example, although the set of the polygon which was 
able to be set in order must be generated when creating the computer graphics of a body 
10 head etc. using the extracted profile data, for that, the data of the boundary point must 
set in order. 

[0112] The boundary extractor 7 is used in order to generate the boundary point which 
was able to be set in order. 

15 

[0113] The concrete procedure is as follows. First, four points are chosen from the 
boundary point sets B, for example. It considers as the initial set of boundary point set 
B ! which was able to set this in order, and these points are made into B ! = {bl , b2, b3, 
b4} (step Bl of drawing 4 ). What is necessary is not to be necessarily four points and 
20 just to specify three or more points as an initial set of a boundary point set. 

[0114] Moreover, as a direction of sequencing, when each point of B f is moved with bl 
->b2 ->b3 ->b4 ->bl in order, it sets in order, for example so that a clockwise closed 
contour may be drawn on a two-dimensional image. As a direction of sequencing, not 
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15 



ly this but a counterclockwise rotation is sufficient, and the direction should just be 



on 

unified by all boundary point sets. 
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[01 15] Next, a midpoint is added between each boundary point belonging to that of B* 
(step B-2 of drawing 4 ). This is expressed as {bl, bl2, b2, b23, b3, b34, b4, b41}. In 
the case of bl2, as a midpoint, the point of dividing into two equally the straight line 
which connects two bl and b2 is used, for example. 



10 mi 



[0116] Next, that point investigates whether it is the boundary point about each 
idpoint (in this case, bl2, b23, b34, b41) added newly (step B3 of drawing 4 ). 



[0117] If it is the boundary point, it will adopt as a point which belongs to B' as it is, 
and will progress to step B4. If it is not the boundary point, it will progress to step B5 of 
drawing 4 . 



[0118] In step B4 of drawing 4 , when all midpoints become settled as the boundary 
point, it investigates whether a new midpoint can be added to B', and if an addition is 
possible, it will progress to step B-2. When it cannot add, it progresses to step 1 10, and 
boundary point set B' which it is as a result of a profile extract and which was able to be 
set in order is outputted, and it ends. When it cannot add, it is the case where all the 
adjacent points belonging to B' adjoin mutually, and a midpoint does not exist etc. 
Therefore, it will mean that all the boundary points have connected this, and the desired 
border line will be obtained. 
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[0119] When a midpoint is not the boundary point, it investigates whether the field 
inner point has come, and if it is the field inner point, a midpoint will be moved by 1 
pixel towards the direction of the exterior (step B6 of drawing 4 ). 

[0120] If it is not the field inner point, a midpoint will be moved by 1 pixel towards the 
direction of the interior of a field (step B7 of drawing 4 ). After moving a midpoint in 
the direction of the interior, or the direction of the exterior, it progresses to step B3 
again, and investigates whether it is the boundary point. 

r • 

; [0121] In one example of this invention, by computer performed on the computer which 
constitutes an image processing system, or a picture signal processing processor, data 
analysis equipment 1 , field imputed probability calculation equipment 2, the renewal 
equipment 3 of a parameter, performance-index calculation equipment 4, the field 
decollator 5, field imputed judging equipment 6, and each equipment of the boundary 
extractor 7 may carry out its processing and function, as it realizes, in this case, it 
realizes according to the above-mentioned flow chart, and a record medium to this 
record medium that stored this program (firmware) carries out reading appearance, the 
function of each equipment is realized by carrying out reading appearance of this 
program to the main storage of a computer, and executing it through equipment, and the 
program or firmware which controls each processing can carry out this invention. 

» * 

[0122] Next, the 2nd example of this invention is explained. In addition, it omits about 
processing in the 1st example of this invention, and common processing. Drawing 7 is 
the block diagram showing the configuration of the profile extractor in the 2nd example 
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of this invention, and drawing 8 is a flow chart which shows the procedure of the profile 
extractor in the 2nd example of this invention. 



[0123] The profile extractor shown in drawing 7 adds the data rough **-ized equipment 
8 which forms the given image into rough **, and the data fragmentation equipment 9 
which subdivides again the data formed into rough ** to the profile extractor of drawing 



1 . 



[0124] Next, processing of the profile extractor of the 2nd example of this invention is 
10 explained with reference to drawing 8 . 



[0125] After performing step 101 in said 1st example, the obtained image is formed into 
rough ** in data rough **-ized equipment 8. The concrete approach of the formation of 
rough ** is as follows. 



[0126] For example, in the pixel indicated to be rough **-ization of 2x2 to drawing 6 , 
the sum of the pixel value of a number {1, 2,257,258} is taken, this is divided by several 
4 of a pixel, and an average value is calculated, and let this be the value of the pixel 
number 1 of the data formed into rough **. 



20 



[0127] the same carrying out -- the pixel set of a number {3, 4,259,260} - rough -- it 
**-izes and considers as the value of the pixel number 2 of the data formed into rough 



** 

* 
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[0128] If this procedure is performed about all pixel sets of 2x2 which does not overlap 
mutually, the image data formed into rough ** will be obtained. Even if it performs 
magnitude of the formation of rough ** in the magnitude of not only 2x2 but others, it 
is natural. [ of the ability to perform similarly ] 

[0129] In the procedure of this formation of rough **, the number of the pixels set as 
the object of analysis is set to one fourth, and can shorten the processing time of a 

* 

profile extract. 

[0130] Moreover, since an image is graduated by rough **-ization, the effect of the 
irregularity of dirt unrelated to an original profile or details is mitigable, Data rough **- 
ized equipment 8 sends data to data analysis equipment 1, after performing rough **- 

* * 

ization of data. 

[0131] Then, after performing step 107 from step 102 in said 1st example and 
completing optimization of a performance index, in step 112, it investigates whether the 
image formed into rough ** is subdivisible. 

[0132] For example, if the first rough **-ization is performed in the magnitude of 
16x16, it will be made to perform next rough **-ization by 8x8. Since rough **-ization 
beyond this cannot be performed when this is repeated and the magnitude of the 
formation of rough ** is set to lxl, it progresses to step 108. If the formation of rough 
** is possible, it will progress to step 113. 

[0133] In data fragmentation equipment 9, based on a field imputed probability, an 
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external field part is deleted and it progresses to step 114 at step 113. It is further 
reduced by this and the pixel set as the object of a profile extract becomes accelerable [ 
the further processing ] by it. 



[0134] At step 1 14, it subdivides and the pixel which remained after deletion is sent to 
data analysis equipment 102. 



[0135] Next, using the profile extractor concerning this invention, the profile of the field 
corresponding to a brain is extracted from a actual MRI image, and the example of the 
evaluated result is explained. 



[0136] Drawing 8 is setting-as object of profile extract MRI image data, and the black 
part of the circumference corresponding to the scalp in the field corresponding to a brain 
in a white part and the white field surrounding it is an external field. 



[0137] Showing [ from this image, are the approach of this invention, searched for the 
field imputed probability over each field, and / that result ] things are drawing 9 , 
drawing 1 0 , and drawing 1 1 . 



[0138] Here, rough **-ization of 16x16 is performed and field imputed distribution is 
searched for. Drawing 9 shows the probability distribution which belongs to an external 
field, and is displayed so white that the probability for each pixel to belong outside is 
high, the same - carrying out -- drawing 10 -- the scalp - the probability belonging to a 
field and drawing 1 1 show distribution of the probability belonging to a brain, 
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respectively. When a field imputed probability is searched for so that clearly also from 
these drawings, it can be said that coarse field separation is completed mostly. 

[0139] Moreover, drawing 12 shows the cerebral profile extracted with the application 
of the approach of this invention. In the MRI image of a basis, although a pixel with 
high brightness exists also in fields other than a brain, it turns out that the cerebral 
profile can be extracted to accuracy, without extracting such a part accidentally. 

■ » 

[0140] 

[Effect of the Invention] As opposed to the image data which contains the image of the 
body set as the object of a profile extract according to this invention as explained above 
By [ which separate the field where said each point belongs using the field imputed 
probability which is a probability for image each point to belong to each field based on 
the attribute which each point of said image has, and extracts the boundary between said 
fields as a profile ] having constituted While being able to extract the profile of each 
field automatically, without setting up the threshold of a field classification explicitly, 
the effectiveness of accelerating a profile field extract is done so. 
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CLAIMS 
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as a 



[Claim(s)] 

[Claim 1] It is based on the attribute which each point of said image has to the image 
data containing the image of the body set as the obj ect of a profile extract. The 1 st 
process which initializes the parameter which specifies the mixed probability 
distribution of the attribute which is the profile extract approach of separating the field 
where each point of said image belongs, and extracting the boundary between said fields 

profile, and each point of the (a) aforementioned image has, (b) The 2nd process 
which computes the field imputed probability for each point of said image to belong to 
each of said field, (c) The 3rd process which updates said parameter so that said mixed 
probability distribution may increase, (d) The 4th process which computes the 
performance index which serves as a scale of presumed goodness from said mixed 
probability distribution specified with said updated parameter, (e) The 5th process 
which separates each field where each point of said image belongs based on the value of 
said field imputed probability, (f) The profile extract approach characterized by what 
the 6th process which extracts the boundary between said separated fields, and the 7th 
process which judges whether each point of said image is the field inner point of the 
called-for field or it is the field outer point based on the (g) aforementioned field 
imputed probability are included for. 



[Claim 2] The profile extract approach according to claim 1 characterized by what is 
performed by repeating said 2nd [ the ], the 3rd, and the 4th process of a call until the 
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predetermined conditions defined beforehand are fulfilled. 

[Claim 3] It asks for the one (e-1) field inner point in the 5th process which separates 
each field where each point of said image belongs. Consider this as the initial set of a 
field inner point set, and the neighborhood-of-a-point point belonging to said (e-2) field 
inner point set is acquired. When the point which considers said near point as the initial 
set of a boundary candidate set, chooses the point belonging to a field inner point set 
from each point of said (e-3) boundary candidate set, adds to a field inner point set, and 
is newly added to said (e-4) field inner point set is lost Acquire the near point to each 
point which belongs said field inner point set to said boundary candidate set in case 
delivery and said (e-5) field inner point set are chosen to said 6th process, and if said all 
near points are the field inner points If the point belonging to said boundary candidate 
set is added to a field inner point set and at least one field outer point is contained in 
said (e-6) near point The profile extract approach according to claim 1 characterized by 
what the field inner point which adds the point belonging to this boundary candidate set 
to a boundary point set, and is not added to a field inner point set among the field inner 
points belonging to said (e-8) near point is added for to said boundary candidate set. 

[Claim 4] In the 6th process which extracts the boundary between said fields, the initial 

value of the boundary point set which was able to be set in order (f-1) is set up. Add the 

- 

midpoint of each point belonging to said boundary point set which was able to be set in 
order, make it move until said (f-3) midpoint turns into the boundary point, and it sets to 
migration of said (f-4) midpoint repeatedly until it becomes impossible to add new 
******** The profile extract approach according to claim 2 or 3 characterized by 
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what it adds to the boundary point set which was able to be set in order when this 
midpoint was already the boundary point, a midpoint will be moved in the direction of 
the field exterior if this midpoint is the field inner point, and will be made to move 
inside a field if this midpoint is the field outer point. 



[Claim 5] The profile extract approach according to claim 2 to 4 characterized by 
having further the 8th process which forms said image into rough **, the 9th process 
which subdivides said image formed into rough **, and the 10th process which deletes 
the point that the probability belonging to a predetermined field is small. 



[Claim 6] The profile extract approach characterized by using said mixed probability 
distribution as said performance index of given [ any 1 ] in claim 1 **** 5. 



[Claim 7] The profile extract approach given in any 1 of claim 1 **** 5 characterized 
by using the SUTORAKUCHURARU risk (Structural Risk) computed from the number 
of said mixed probability distributions and said parameters as said performance index. 



[Claim 8] The profile extract approach given in any 1 of claim 1 **** 5 characterized 
by using the description length computed from the number of said mixed probability 
distributions and said parameters as said performance index. 



[Claim 9] The profile extract approach given in any 1 of claim 1 **** 5 characterized 
by using the information criterion (AIC) of Akaike computed from the number of said 
mixed probability distributions and said parameters as said performance index. 
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[Claim 10] It is based on the attribute which each point of said image has to the image 
data containing the image of the body set as the object of a profile extract. 1st means to 
: initialize the parameter which specifies the mixed probability distribution of the 
attribute which is the profile extractor which separates the field where said each point 
belongs, and extracts the boundary between said fields as a profile, and each point of 
said image has, 2nd means to compute the expected value of the field imputed 
probability for each point of said image to belong to each of said field, 3rd means to 
update said parameter so that said mixed probability distribution may increase, 4th 
means to compute the performance index used as the scale of presumed goodness from 

* 

said mixed probability distribution specified with said updated parameter, The profile 
extractor characterized by having 5th means to separate each field based on the value of 
said field imputed probability, 6th means to extract the boundary between said separated 
fields, and 7th means by which image each point judges the field inner point or the field 

* 

t • * 

outer point based on said field imputed probability. 

[Claim 11] The profile extractor according to claim 10 characterized by having 8th 
means to form said image into rough **, 9th means to subdivide said image formed into 
rough **, and 10th means to delete the point that the probability belonging to a 
predetermined field is small. 

[Claim 12] The field profile extract approach characterized by what the image data 

■ 

containing the image of the body set as the object of a profile extract inputs from an 
input means, the field imputed probability which is a probability for each point of said 
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image to belong to each field computes based on the attribute which each point of said 
image has, the field where said image each point belongs using this field imputed 
probability separates, and the boundary between said fields extracts for as a profile. 



[Claim 13] (a) As opposed to the image data containing the image of the body set as the 
object of a profile extract inputted from the input means The step which computes the 
expected value of the field imputed probability for each point of an image to belong to 
each of a field, based on the attribute which each point of an image has, (b) The step 
which updates the parameter which specifies the mixed probability distribution of the 
attribute which each point of an image has, (c) The step which computes a performance 
index based on the mixed probability distribution searched for from said field imputed 
probability and said parameter, (d) The field profile extract approach which separates 
each field based on said field imputed probability, and is characterized by what the step 
which extracts a profile based on the this separated field is included for when said 
performance index fulfills predetermined conditions. 



[Claim 14] The data analysis equipment which defines the initial value of the field 
parameter by which analyzes the property of the image data inputted from the input 
device, and each field of an image is characterized, The field imputed probability 
calculation equipment which computes the probability (it is called a "field imputed 
probability") for each point of an image to belong to each field, based on the value of 
each point of an image, The renewal equipment of a parameter which updates said field 
parameter so that the value of a performance index may increase according to the 
performance index to be used or it may decrease, The performance-index calculation 
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equipment which computes a performance index from the updated field parameter, The 
field decollator which determines to which field each point of an image belongs based 
on the presumed field imputed probability when fulfilling the predetermined terminating 
condition as which said performance index was determined beforehand, The field 
imputed judging equipment which judges whether the specified point belongs to the 
specified field about the point of the image used as the boundary of each field, The 
profile extractor which is equipped with the boundary extractor which generates the 
border line to which sequence was attached from the extracted field, and the output unit 
which outputs the result of a profile extract, and is characterized by things. 

[Claim 15] When it is beyond the predetermined value as which the difference of the 
value of the performance index computed in said performance-index calculation 
equipment and the value of the last performance index computed using the field 

* 

parameter before updating was determined beforehand, it sets to said field imputed 
probability calculation equipment. A field imputed probability is again computed using 
a new field parameter. Renewal of the field parameter in said renewal equipment of a 
parameter, The performance index in said performance-index calculation equipment is 
computed. Said difference rather than said predetermined value In the case of smallness 
The field parameter and field imputed probability which make max mixed probability 
distribution which took the weighted average of the probability in each field of the value 
which each point of said image has are searched for. Said performance-index 
calculation equipment The profile extractor according to claim 14 characterized by what 
the field imputed probability and field parameter which were obtained are sent for to 
said field decollator after maximization of said mixed probability distribution is 
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completed. 



[Claim 16] A means by which said field decollator asks for the first field inner point, 
acquires the near point of said field inner point, and makes said near point the first 
boundary candidate point-set, When a means to acquire said boundary candidate 
neighborhood-of-a-point point, and all the points of said near point are the field inner 
points, A means to add said boundary candidate point to the field inner point set R, and 
to, add said boundary candidate point to a boundary point set on the other hand when all 
the points of said near point are not the field inner points, A means to add the field inner 
point which is not registered into a field inner point set among the field inner points 
belonging to said boundary candidate neighborhood-of-a-point point to said boundary 
candidate point-set, The profile extractor according to claim 14 characterized by what 
processing is repeated for from a means to acquire said boundary candidate 
neighborhood-of-a-point point when the addition to a preparation and said boundary 
candidate point-set is. 



[Claim 17] The means which said boundary extractor considers as the initial set of the 
boundary point set which chose the point of the predetermined number from said 
boundary point sets, and was able to set this in order, If a means to add a midpoint 
between each boundary point belonging to said boundary point set which was able to be 
set in order, a means to investigate whether this midpoint is the boundary point about 
said each midpoint added newly, and said midpoint are the boundary points it adopting 
as a point belonging to said boundary point set which was able to be set in order, and 
investigating whether when all midpoints become settled as the boundary point, it is 
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alike, and a new midpoint can be added, and, if an addition is possible A means to add 
said midpoint is processed. When it cannot add A means to output the boundary point 
set which it is as a result of a profile extract and which was able to be set in order, and 
when said midpoint is not the boundary point Investigate whether the field inner point 
has come, when it is the field inner point, move a midpoint towards the direction of the 
exterior, and on the other hand, if it is not the field inner point The profile extractor 
according to claim 14 characterized by what it had the means to which a midpoint is 
moved towards the direction of the interior of a field, and a means to investigate 
whether the point is the boundary point about said midpoint after moving a midpoint in 
/the direction of the interior of a field, or the direction of the exterior for. 

■ ■ 

[Claim 18] [ when the performance index which was equipped with the data rough **- 
ized equipment which forms into rough ** the image data inputted from said input 
device, and is outputted to said data analysis equipment, and was computed with said 
performance-index calculation equipment fulfills a predetermined terminating condition 
] The profile extractor according to claim 14 characterized by having data fragmentation 
equipment which deletes an external field part based on a field imputed probability, 
subdivides the point of the image which remained after deletion, and is sent to said data 
analysis equipment when it can subdivide. 

[Claim 19] (a) The data analysis processing which defines the initial value of the field 
parameter by which analyzes the property from the image data inputted from the input 
device, and each field of an image is characterized, (b) Field imputed probability 
calculation processing which computes the probability (it is called a "field imputed 
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probability") for each point of an image to belong to each field, based on the value of 
each point of an image, (c) The parameter update process which updates said field 
parameter so that the value of a performance index may increase according to the 
performance index to be used or it may decrease, (c) Performance-index calculation 

5 processing which computes a performance index from the updated field parameter, (d) 
Field separation processing in which it is determined to which field each point of an 
image belongs based on the presumed field imputed probability when said performance 
index fulfills a predetermined terminating condition, (f) Field imputed judging 
processing in which it judges whether the specified point belongs to the specified field 

1 o about the point of the image used as the boundary of each field, (g) Record medium 
which recorded the program for performing each processing of the above (a) of 
boundary extract processing and ** thru/or (g) which generates the border line to which 
sequence was attached from the extracted field by computer. 
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